This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



THIS PAGE BLANK (uspto) 



(19) 



J 



(12) 



(43) Date of publication: 

31.03.1999 Bulletin 1999/13 

(21) Application number: 97810708.4 

(22) Date of filing: 26.09.1997 



EuropSisches Patentamt 
European Patent Office 
Off ice europgen des brevets (11) EP 0 905 967 A1 

EUROPEAN PATENT APPLICATION 

(51) Int. CI. 6 : H04N 1/32 



(84) Designated Contracting States: 


• Oruanaidh, Joseph J.K. 


AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 


1227 Geneve (CH) 


NL PT SE 


• Pun, Thierry 


Designated Extension States: 


1224 Ch&ie-Bougerles (CH) 


AL LT LV RO SI 






(74) Representative: 


(71) Applicant: 


Blum, Rudolf Emil Ernst et al 


Digital Copyright Technologies AG 


c/o E. Blum & Co 


8004 Zurich (CH) 


Patentanwarte 




Vorderberg 11 


(72) Inventors: 


8044 Zurich (CH) 


• Herrigel, Alexander 




8706 Meilen (CH) 





(54) Method for generating digital watermarks and for exchanging data containing digital 
watermarks 

(57) A method for generating digital watermarks 
and for exchanging data containing such watermarks is 
described. The system is based on an watermarking 
technique which is robust against image transformation 
techniques such as compression, rotation, translation, 
and scaling. It uses modulation of the magnitude com- 
ponents in Fourier space and adds/reads a template in 
the log polar transform of the magnitude components. 
The template is used for analyzing scaling and rotation. 
In addition, the system applies cryptographic protocols 
and public key techniques for both, encoding the water- 
mark and transferring watermarked data. Preferably, an 
author (ICH) encodes the watermark using an asym- 
metric cryptographic key pair provided by a public key 
infrastructure (PKI) and registers the watermarked data 
at a trusted registration party (ICO) before transmitting 
the data to a receiving party (IB). The latter can use the 
public key infrastructure (PKI) for verifying authorship. 
Transmission between the parties uses data protection 
provided by the cryptographic keys. 
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Description 

[0001] The present invention relates to a method for 
generating digital watermarks and for transmitting data 
containing digital watermarks according to the preamble 
of the independent claims. 

[0002] Digital watermarking is a method for marking 
data sets, such as images, sound or video. A digital 
watermark consists of a slight modification of the data 
set that does not affect the data set's usability but that 
can be detected using dedicated analysis software or 
apparatus. Watermarking can e.g. be used for marking 
authorship or ownership of a data set. 
[0003] Digital watermarking can be seen as a funda- 
mental-problem in digital communications (see e.g. I. 
Cox, J. Killian, T. Leighton, and T. Shamoon, "Secure 
spread spectrum communication for multimedia", Tech- 
nical report, N.E.C. Research Institute, 1995). Early 
methods of encoding watermarks consisted of no more 
than incrementing an image component to encode a 
binary T and decrementing to encode a '0' (G. Caronni 
"Assuring Ownership Rights for Digital Images" in H. H. 
Brueggemann and W. Gerhardt-HaecW, editors, Relia- 
ble IT Systems VIS '95, Vieweg Publishing Company, 
Germany, 1995). Tirkel et al. (A. 2. Tirkel. G. A. Rankin, 
R. G. van Schyndel. W. J. Ho, N. R. A. Mee. and C. F. 
Osborne, "Electronic watermark", in Dicta-93, pages 
666-672, Macquarie University, Sydney, December 
1993) and van Schyndel et al. (A. 2. Tirkel, R. G. van 
Schyndel, and C. F. Osborne, "a two-dimensional digital 
watermark", in ACCV95, pages 378-383, University of 
Queensland, Brisbane, December 6-8 1995) have 
applied the properties of m-sequences to produce obliv- 
ious watermarks resistant to filtering, cropping and rea- 
sonably robust to cryptographic attack. Matsui and 
Tanaka (K. Matsui and K. Tanaka, "Video-Steganogra- 
phy : How to secretly embed a signature in a picture", in 
IMA Intellectual Property Project Proceedings, pages 
187-206, January 1994) have applied linear predictive 
coding for watermarking. Their approach to hiding a 
watermark is to make the watermark resemble quanti- 
zation noise. Tirkel and Osborne (see above) were the 
first to note the applicability of spread spectrum tech- 
niques to digital image watermarking. Since then there 
has been an increasing use of spread spectrum in dig- 
ital watermarking. It has several advantageous features, 
such as cryptographic security (see Tirkel and Osborne, 
above), and is capable of achieving error free transmis- 
sion of the watermark near or at the limits given by the 
maximum channel capacity (J. Smith and B. Comiskey, 
"Modulation and information hiding in images", in Ross 
Anderson, editor, Proceedings of the First International 
Workshop in Information Hiding, Lecture Notes in Com- 
puter Science, pages 207-226, Cambridge, UK, 
May/June 1996. Springer). Fundamental information 
theoretic limits to reliable communication have been dis- 
cussed by some authors (see Smith and Comiskey, 
above). The shorter the payload of a watermark, the 



better are the chances of it being communicated relia- 
bly. Spread spectrum is an example of a symmetric key 
cryptosystem (B. Schneier, "Applied Cryptography", 
Wiley, 2nd edition, 1995). System security is based on 

5 proprietary knowledge of the keys (or pseudo random 
seeds) which are required to embed, extract or remove 
an image watermark. One provision in the use of a 
spread spectrum system is that it is important that the 
watermarking be non-invertible because only in this way 

w can true ownership of the copyright material be resolved 
(S. Craver, N. Memon, B. Yeo, and M. Yeung, "Can invis- 
ible marks resolve rightful ownerships ?", IS&T/SPIE 
Electronic Imaging '97 : "Storage and Retrieval of Image 
and Video Databases", 1997). 6 Ruanaidh et al. (J. K. 

75 6 Ruanaidh, W. J. Dowling, and F. M. Boland, "Phase 
watermarking of images", IEEE International Confer- 
ence on Image Processing, Lausanne, Switzerland, 
September 1996) and Cox et al. (see above) have 
developed perceptually adaptive transform domain 

so methods for watermarking. In contrast to previous 
approaches listed above the emphasis was on embed- 
ding the watermark in the most significant components 
of an image. The general approach used in these 
papers is to divide the image into blocks. Each block is 

25 mapped into the transform domain using either the Dis- 
crete Cosine Transform (W. B. Pennebaker and J. L. 
Mitchell, "JPEG Still Image Compression Standard", 
Van Nostrand Reinhold, New York, 1993), the Had- 
amard Transform (W. G. Chambers, "Basics of Commu- 

30 nications and Coding", Oxford Science Publications. 
Clarendon Press Oxford, 1985) or the Daubechies 
Wavelet Transform (W.H. Press, S.A. Teukolsky, WT. 
Vetterling, and B.R Flannery, "Numerical Recipes in C", 
Cambridge University Press, second edition, 1992). 

35 Information has been embedded using the DCT (J. J. K. 
6 Ruanaidh, W. J. Dowling, and F. M. Boland, "Water- 
marking digital images for copyright protection", IEEE 
Proceedings on Vision, Image and Signal Processing, 
143(4) :250-256, August 1996, based on the paper of 

40 the same title at the IEEE Conference on Image 
Processing and Its Applications, Edinburgh, July 1995) 
FFT magnitude, and phase, Wavelets (see refs. of Rua- 
naidh, Dowling and Boland, above), Unear Predictive 
Coding (see Matsui et al. r above) and fractals (P. Dav- 

45 ern and M. Scott, "Fractal based image steganography", 
in Ross Anderson, ed., Proceedings of the First Interna- 
tional Workshop in Information Hiding, Lecture Notes in 
Computer Science, pp. 279-294, Cambridge, UK, 
May/June 1996. Springer Verlag). 

so [0004] The industrial importance of digital watermark- 
ing has resulted in a number of products on the market, 
either based on spread spectrum techniques or addi- 
tional registration services. They include the Picture- 
marc system by Digimarc, SureSign (former FBI's 

55 Fingerprint) by HighWater Signum, IP 2 system by Intel- 
lectual Protocols, the Argent system by Digital Informa- 
tion Commodities Exchange, the PixelTag system by 
the MIT Media Lab, the SysCop system from Zhao and 
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Koch by the Frauenhofer-lnstitut fur Graphische Daten- 
verarbeitung (J. Zhao and E. Koch, "Embedding robust 
labels into images for copyright protection", Technical 
report, Fraunhofer Institute for Computer Graphics, 
Darmstadt, Germany, 1994. J. Zhao, "A WWW Service 
To Embed And Prove Digital Copyright Watermarks", 
Proc. Of the European Conference on Multimedia Appli- 
cation, Services and Techniques, Louvain-La-Neuve, 
Belgium, May 1996), and the Tigermark system from 
NEC. 

[0005] The approach of Zhao and Koch, based on the 
JPEG image compression algorithm, proceeds by seg- 
menting the image into individual 8x8 blocks. Only 
eight coefficients occupying particular positions in the 8 
x 8 block of DCT coefficients can be marked. These 
comprise the low frequency components of the image 
block but exclude the mean value coefficient as well as 
the low frequencies. Three of the remaining DCT coeffi- 
cients are selected using a pseudo random number 
generator to convey information. The resemblance of 
this technique to frequency hop spread spectrum com- 
munications is also mentioned and the blocks are 
placed at random positions in the image. A WWW regis- 
tration service has been proposed for a local registra- 
tion and a local watermarking, for a server registration 
and a server watermarking, and for a local watermark- 
ing and a server registration. 

[0006] J.-F. Delaigle at al. (J.-F Delaigle. J.-M. Bouc- 
queau, J.-J. Quisquater & B. Macq, "Digital Images pro- 
tection techniques in a broadcast framework: An 
overview", Laboratoire de Telecommunications et de 
T6!6d6ction, University Catholique de Louvain) have 
applied signature labelling techniques for the copyright 
protection of digital images. Their approach is based on 
an enhanced image format and generates a digital sig- 
nature label in front of the image. This signature label 
can be easily overwritten or destroyed. 
[0007] It is an objective of the present invention to pro- 
vide a system of the type mentioned initially that pro- 
vides a simple and secure way of generating and 
transmitting watermarked data. 

[0008] In one aspect of the invention, this object is 
achieved by using an asymmetric private and public key 
pair, as it is used in cryptography. The original data set 
(cover data set, cover image) is watermarked, wherein 
the watermark is encoded using one or both of said 
keys. The watermarked data set (stego data set, stego 
image) is then transmitted to a second party, wherein 
the same keys are used for establishing a secure trans- 
mission between the parties. This simplifies the admin- 
istration of keys since the only keys required are the key 
pair mentioned above. In addition to this, because cryp- 
tographic keys are less prone to guessing attacks than 
simple passwords, the security of the watermark is 
improved. 

[0009] In a preferred embodiment, both parties use 
asymmetric key pairs and a key protocol for establishing 
a common key between them. 



4 

[001 0] The party creating the watermark can embed a 
private as well as a public watermark in the data set, 
wherein the private watermark is derived from the pri- 
vate key, the public watermark from the public key. The 

5 public watermark can be detected by third parties while 
the private watermark can only be detected using pri- 
vate information. Preferably, the private watermark is 
not derived from the private key directly but from a hash 
value of the same, such that the author of the water- 

10 mark does not have to reveal his private key if the pri- 
vate watermark is to be verified. 
[001 1 ] In a further aspect of the invention, the author 
of the watermark is again provided with an asymmetric 
cryptographic key pair. He embeds a message together 

15 with its cryptographic signature in the watermark When 
verifying this watermark, the presence of the signature 
increases reliability because it proves that the message 
was signed by the author. 

[001 2] In yet another aspect of the invention, the cover 
20 data set is provided with a digital watermark and then 
transmitted to a registration party that permanently 
stores at least a hash value, time information and origin 
of the stego data set. 

[0013] In another aspect of the invention, a template 
25 modulation pattern is added to the Fourier transform of 
an image that is to be provided with a watermark. For 
checking the watermark, the Fourier transform of the 
stego-image is calculated. From this Fourier transform, 
the log polar mapping transform is generated, which is 
30 then searched for the modulation pattern. Using the log 
polar transform of the Fourier transform has the advan- 
tage that scaling and rotation of the stego image are 
expressed in translations. This allows an easy search 
for rotation and scaling using cross-correlation tech- 
35 niques. 

[0014] In still another aspect of the invention, the 
image to be watermarked is divided into blocks and the 
magnitude components of the Fourier transform of each 
block is modulated using the same pattern. This method 

40 provides robustness against cropping of the stego- 
image because a cropping leads to a circular translation 
in each block. Preferably, the magnitude components of 
the Fourier transform are modulated, wherein the sign 
of the modulation should be derived from the phase 

45 components, thereby reducing interference between the 
image data and the watermark as explained in the fol- 
lowing disclosure. 

[0015] Further aspects, advantages and applications 
of the invention are described in the claims and the fol- 
so lowing description, which description makes reference 
to the figures. They show: 

Fig. 1 the parties involved in individual watermark 
protection, 

55 Fig. 2 the parties involved in watermark protection 
using registered cryptographic keys, 
Fig. 3 the parties involved in watermark protection 
using registered cryptographic keys and a registra- 
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tion party, 

Fig. 4 the steps taken for embedding a watermark, 

Fig. 5 the steps for generating the template, 

Fig. 6 the steps for reading a watermark, 

Fig. 7 the steps for reading the template, 5 

Fig. 8 the tiling of the watermark in a stego-image, 

and 

Fig. 9 the tiling of the watermark in a cropped 
stego-image. 

10 

I. Terms and Symbols: 

[0016] Before describing a preferred method and 
apparatus according to the invention, some key terms 
and symbols used in its description are explained in the 75 
following: 

" Image ": An image in either digital or physical form 
which may constitute a still image or a video frame. 
It can also refer other types of data, such as video 20 
and sound, in particular when being used within the 
context of the protection and owner authentication 
methods of section II of the disclosure. 
" Signal *: A signal in either digital or physical form. It 
may refer to one dimensional or multidimensional 25 
signals such as image and video. 
" Image Copyright Holder flChO ": A party (or a proc- 
ess acting on behalf of it) "owning" a digital image. 
This is the party that generates the watermarks. 
" Imaoe Buyer (IB) ": A party (or a process acting on 30 
behalf it) which obtains (e.g. by purchase) via elec- 
tronic means a specific image from the ICH. 
" Image Authentication Process (IAP) ": A process 
for verifying that the image has been processed 
(generation, storage, retrieval, modification, trans- 35 
mission) before by the tCH. 
" Imaoe Authentication Data ( IAD) ": The authentica- 
tion data used in the IAP. 

" Steoo ": Implies that an image or data is marked 
(i.e. it has an IAD embedded in it). The stego image 40 
is also referred to as the stego data set. 
"Cover ": Implies that an image or data is unmarked 
(i.e. it has no IAD embedded in it). The cover image 
is also referred to as the cover data set. 
" Watermark ": The form the IAD takes when it is in a 45 
form suitable for embedding in a signal. 
" Image Copyright Office (ICQ) ": An organization (or 
a process which acting on behalf it) which registers 
ownership for a specific image. Successful registra- 
tion is based on a verification procedure, e.g. by so 
checking the name and postal address of CH, infor- 
mation how ownership was acquired, the title of the 
image, a description of the type of image (artistic, 
literary, musical, dramatic) and date and place of 
first publication. After successful registration a dig- 55 
ital copyright certificate can be generated. 
" Digital copyright certificate ": Digital copyright data 
which comprise the copyright certificate data and a 



digital signature. 

" Copyright Reouest Data (CRD) ": Copyright data 
which contains the stego image, the image ID of the 
cover image, a Universal Copyright Convention 
Notice, a Copyright Symbol, the term "Copyrighf , 
the year of the copyright, the name of the copyright 
holder, and the phrase "All Rights Reserved". 
" Copyright Certificate Data (CCD) ": Copyright data 
which contains at least an image ID, a hash value of 
the digital image, a time stamp, a Universal Copy- 
right Convention Notice, a Copyright Symbol, the 
term "Copyright", the year of the copyright, the 
name of the copyright holder, and the phrase "All 
Rights Reserved". 

" Digital signature ": A data string which has been 
generated by a digital signature generation trans- 
formation. 

" Digital signature generation transformation ": A 
method for producing a digital signature. 
" Digital signature verification transformation ": A 
method for verifying whether a digital signature is 
authentic or not. 

" Digital signature scheme ": A scheme based on 
asymmetric cryptographic techniques whose pri- 
vate transformation is used for the digital signature 
generation and whose public transformation is used 
tor the digital signature verification. 
" Digital signature scheme with message recovery ": 
A digital signature scheme for which a priori knowl- 
edge of the input data is not required for the signa- 
ture verification transformation. 
" Digital signature scheme with appendix ": A digital 
signature scheme for which the input data is 
required as input to the digital signature verification 
transformation. 

" Asymmetric key pair ": A pair of related crypto- 
graphic keys where the private key defines the pri- 
vate transformation and the public key defines the 
public transformation. 

" Symmetric key ": A cryptographic key used with a 
symmetric cryptographic technique and known only 
to a set of specified entities. 

" Asymmetric key agreement protocol ": A protocol 
whereby a shared symmetric key becomes availa- 
ble to two parties for subsequent cryptographic use. 
The symmetric key is exchanged on the basis of a 
digital signature scheme with message recovery. 
The signed keys are encrypted with an asymmetric 
public key. 

" Public Key Infrastructure (PK1) ": An organization 
(or processes which acts on behalf of it) which 
offers services for the generation, registration, cer- 
tification, distribution, validation, and revocation of a 
certificate associated with an asymmetric key pair. 
" Public watermark ": A watermark that can be 
detected using a publicly available key (or a hash 
value thereof). 

" Private watermark ": A watermark that can only be 
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detected using a secret key (or a hash value 
thereof). It is not possible for an unauthorized third 
party to overwrite or delete the private watermark 
without the cryptographic secret keying information. 
" Embedded authentication data ": The hidden IAD. s 
"Payjoad": The core of the hidden IAD in bit form 
without error control coding applied. 
" Image ID ": The following format scheme for a glo- 
bally unique ID: The first 3 bytes determine the ICO, 
the following 3 bytes determine the ICH ID defined w 
by the ICO. Finally the ICH can freely assign last 4 
bytes for each one of his digital images. 
" Oblivious ": A watermarking technique which does 
not require the cover image for extracting the mark. 
In other words, only the stego image is required to is 
extract the mark when using an oblivious marking 
scheme. 

"Template ": A hidden message encoded in the 
image. By detecting the template, the scaling 
(zooming) and rotation suffered by a stego-image 20 
can be determined. 

" Pseudo random seed ": A value used to initialize a 
pseudo random number generator. 



Symbols: 



[0017] 



25 



H distinguished (unique) name of the Image Copy- 
right Holder H 30 

0 distinguished name of the Image Copyright 
Office O 

B distinguished name of the Image Buyer B 

1 distinguished name of the Public Key Infrastruc- 
ture 35 
Cert H entity H's public key certificate from I 

Certo entity O's public key certificate from I 
Cert B entity B's public key certificate from I 
(Px * v x) tne elliptic curve key pair, with a key size of 
at least 209 bits, of an entity with the distinguished 40 
name X. See Alfred J. Menezes, Paul C. Van Oor- 
schot, and Scott A. Vanstone, "Handbook of 
Applied Cryptography", CRC Press, 1996, ISBN 0- 
8493-8523-7 

CC a copyright certificate 45 
KS key size of the elliptic curve pair 
DSSMR G (X,Y,Z) an elliptic curve based digital sig- 
nature generation scheme with message recovery, 
where X denotes the private key, Y the input data to 
be signed, and Z the resulting signature. so 
DSSMR V (X,Y,Z) an elliptic curve based digital sig- 
nature verification scheme with message recovery, 
where X denotes the public key, Y the input data, 
and Z the resulting output data. 
DSSAP G (X,Y,Z) an elliptic curve based digital sig- 55 
nature generation scheme with appendix, where X 
denotes the private key, Y the input data to be 
signed, and Z the resulting signature. 



DSSAP V (X,Y,Z) an elliptic curve based digital sig- 
nature verification scheme with appendix, where X 
denotes the public key, Y the input data, and Z the 
resulting output data. 

K XY a secret key for a symmetric cryptosystem 
shared between two entities with the distinguished 
name X and Y. 

K XY [Data] denotes the cipher text generated by a 
symmetric cryptosystem with plain text Data, 
crh a collision resistant hash function 

AKAP(X,Y ( Kxy.PSx »vsx. PCx. vCx.PSy v Sy. PCy. vc y) 
applied asymmetric key agreement protocol (see 
ISO/IEC 11770-3, "Information technology-Security 
techniques-Key management, Part 3: mechanisms 
using asymmetric techniques") with entity X's pri- 
vate signature key ps x , entity X's public verification 
key vs x , entity X's private deciperment key pc x , 
entity X's public encipherment key vc x , entity Y's 
private signature key ps Y , entity Y's public verifica- 
tion key vs Y entity Y's private decipherment key 
pc Y , and entity Y's public encipherment key vc Y 
between the entities with the distinguished name X 
and Y. After the protocol was successfully executed, 
the two entities have agreed on a K XY . 
OIAE(X.Y,CI. SI) the oblivious image owner authen- 
tication embedding algorithm with the seed X, the 
payload Y, the cover image CI. and the resulting 
stego image SI. 

OIAV(X,SI,Y) the oblivious image owner authenti- 
cation detection algorithm with the seed X, the 
stego image SI, and the resulting payload Y) 
TVP time-variant parameter, such as a random 
number, a time-stamp, or a sequence number. 
|| concatenation of two data elements in this order. 
CI Cover Image 
SI Stego Image 

II. Protection and owner authentication: 

[0018] Depending on the proof-level to be provided for 
the protection, the preferred embodiment of the appara- 
tus and method according to the invention provides 
three different levels of reliability, which are based on 
each other, namely: individual watermark protection, 
watermark protection with registered cryptographic 
keys, and watermark protection with an ICO on the 
basis of registered cryptographic keys. 
[001 9] The present method and apparatus is based on 
an image owner authentication technique, described 
below, which embeds and detects the IAD as the pay- 
load of a watermark. The applied image owner authen- 
tication technique is based on a perceptually adaptive 
spread spectrum technique which provides reliable 
means of embedding robust watermarks. Such a tech- 
nique will be discussed in section HI. In addition, a 
spread spectrum techniques is a form of symmetric 
cryptosystem. In order to embed or extract a water- 
mark, it is necessary to know the exact values of the 
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seed used to produce pseudo random sequences used 
to encode a watermark. The seeds are considered to be 
cryptographic keys for watermark generation and verifi- 
cation. System security can therefore be based on pro- 
prietary knowledge of the keys and provide in addition 
the necessary security parameters needed for a secure 
communication (mutual authentication, integrity, confi- 
dentiality, non-repudiation) in the trading process of dig- 
ital images. Because spread spectrum signals are 
statistically independent (and therefore virtually orthog- 
onal), the present method and apparatus encodes more 
than one watermark in an image at the same time, 
namely private watermarks and public watermarks. The 
public watermarks indicate that the image is copyright 
material and provide information on true ownership. At 
the same time there are secure private watermarks 
whose secrecy depends on the private key of the asym- 
metric key pair of the ICH. 

[0020] Since the system provides for the registration 
of the public key of the asymmetric key pair, the ICH can 
prove that he is the only person in the possession of the 
adequate private key of the asymmetric key pair and, 
therefore, the generator of the private watermarks. 
[0021] The system also provides the secure registra- 
tion (mutual authentication, integrity, confidentiality, 
non-repudiation) of watermark encoded images (data 
sets) at an ICO. The stego image is registered at the 
ICO and a digital copyright certificate is generated 
which is signed by the ICO. If an unauthorized third 
party has also encoded watermarks in the same image, 
conflicting claims in copyright disputes can be resolved. 
Examining the time stamps of the copyright certificate 
enables the secure identification of the legal owner: The 
earliest of the time stamps identifies the legal owner if 
no copyright revocation request has been applied. 
[0022] Watermark protection with registered crypto- 
graphic keys and the ICO based copyright protection 
are based on a PKI. The PKI issues on request public 
key certificates containing the public key of the party, 
the distinguished name of the party, and a time stamp. 
Every certificate is signed with the PKI's private key and 
the trust is built on the validity of the authentic copy of 
the PKI's public key (we assume that the public key of 
the PKI is accessible, authentically distributed, and ver- 
ifiable by every party). 

[0023] In the following the three levels of the system 
are described. 

a) Individual watermark protection 

[0024] As shown in Fig. 1 , the apparatus for the indi- 
vidual copyright protection is partitioned into two proc- 
esses, namely the ICH with the distinguished name H 
and the IB process with the distinguished name B. Sup- 
pose (ps H ,vs H ) and (pc H , vc H ) are the elliptic curve key 
pairs of H, (ps B ,vs B ) and (pc B , vc B ) are the elliptic curve 
key pairs of B. Suppose H has an authentic copy of vs B , 
vc B and B has an authentic copy of vs H , vc H before they 



start any communication. 

[0025] The following phases are applied by the proc- 
esses of the individual copyright protection apparatus: 

5 Phase 1 : 

H retrieves the cover image CI, generates a unique 
image identifier ID C) , stores ID C) , and retrieves the key 
pair (ps H .vs H ). 

10 

Phase 2 (generating private watermark): 
[0026] 

75 1 . H generates a private I AD C | applying 
DSSMRqCpsh, ID C |, IAD C |). 

2. H partitions, depending on the key size KS, the 
20 IAD C | into different blocks BLj, 1 < i <, P, with a length 

of 1 28 bits (P := H AD C , /KS"|). This ensures that the 
blocks to be included in each watermark are suffi- 
ciently small. 

3. H generates the stego image SI applying for 
25 every i, 1 ^ i ^ R using the transformation: 

OIAE(crh(ps H ) XOR crh(i), BLj, Cl i( Slj), 

where Clj denotes the cover image (stego image 
30 from the previous iteration, Cli := CI) and Slj 
denotes the stego image of iteration i. The resulting 
stego image is then SI := SI P Set CI* := SI. 

Phase 3 (generating public watermark): 

35 

[0027] H generates a public IAD C) applying 

DSSMR G (ps H , CD, IAD C |), 

40 with CD := "Copyright by"||H||TVP|| "All Rights 
Reserved". 

H again partitions, depending on the key size KS, the 
IAD C | into different blocks BLj, 1 £ i < P, with a length of 
128 bits (P := riAD cl /KSl). 
45 H generates the stego image SI applying for every i, 1 < 
i < P, the following transformation: 

OIAE(crh(vs H ) XOR crh(i), BLj, Clj, Slj), 

so where Clj is the cover image (stego image from the pre- 
vious iteration, C^ = CI*, with CI* from the previous 
phase) and Slj is the stego image of iteration i. The 
resulting stego image is SI = SI P 

55 Phase 4: 

H stores the resulting stego image SI and may generate 
a signed copyright certificate. 
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Phase 5: 

H and B execute the following steps for the trading of 
copyright protected digital images: 

1. H and B execute 

AKAP(H, B, K HB , ps H , vs H , pc H , vc H . ps B . vs B , 
pc B , vc B ) 

for the generation of a shared symmetric session 
key K HB . 

2. B generates the trading transaction T1, 

T1 <K HB [TD|ISigTD]>, with 
TD := ID C ,||TVP|IB||H, and 
DSSAP G (ps B TD SigTD). 

B then transmits T1 to H. 

3. H receives T1, deciphers K HB [TD||SigTD], and 
verifies TD, applying 

DSSAPv(vs B) SigTD, IVR) 

where IVR denotes the intermediate verification 
result. If 

IVR = crh(TD), with TD := ID C |||TVPI|B||H, 

then TD has been successfully verified and the next 
step shall be executed. In any other case, the 
processing and communication between the H and 
B is stopped. 

4. If the verification was successful, H retrieves with 
the ID C | information the corresponding stego image 
SI and generates the trading transaction 

T2 := <K HB [TD||SigTD] >, with 

TD := SI ||TVP||H||B, and DSSAP G (ps H , TD 

SigTD). 

H then transmits T2 to B. 

5. B receives T2, deciphers KhbP" d II$'9 td ]. and 
verifies TD, applying 

DSSAPv(vsh, SigTD, IVR), 

where IVR denotes the intermediate verification 
result. If IVR = crh(TD), with TD := SI||TVP||H||B, 
then TD has been successfully verified. B then 
checks the IAD applying for every i, 1 <. i <, P, the fol- 
lowing transformation: 

OIAV(crh(vs H ) XOR crh(i), SI, PLj). 

where Slj denotes the stego image and PLj the 
detected payload of the i-th public watermark. (If P 
is not known, the procedure is iteratively applied 
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until no more public watermark can be detected). 
The IAD C | is then generated by concatenating the 
PLj, i.e. 

IAD CI :=PL 1 I|PL 2 ||...||PL N ,1 SisR 
IAD C) is then verified applying 

DSSMRyfvSH, IAD C |,OD), 
with OD as the output data. If OD is 

"Copyright by"||H||TVP|| "All Rights Reserved". 

B has verified H as the copyright holder, if the public 
watermarks have not been modified (overwritten). 



Remark: 

20 [0028] In the case of a legal copyright dispute, H can 
retrieve the IAD C) and construct the corresponding 
unique image ID. Since the generation of the same 
asymmetric key pair by two distinguished entities is very 
unlikely, the construction of the unique image ID pro- 

25 vides a good level of proof against copyright infringe- 
ment. In the case of watermark protection with 
registered keys, the generation of the same asymmetric 
key pair by two distinguished entities can be prevented. 
[0029] Depending on the applied asymmetric scheme 

30 the private decipherment key may be identical to the pri- 
vate signature key and the public encipherment key may 
be identical with the public verification key. 



b) Watermark protection with registered keys: 



[0030] As shown in Fig. 2, the apparatus for the copy- 
right protection with registered cryptographic keys is 
partitioned into three processes, namely the ICH with 
the name H, the IB process with the name B, and the 

40 PKI process with the name I. Suppose (ps H .vs H ). 
(PCh.vch), (ps B , vs B ), (pc B . vc B ). (ps,, vsi), and (pci.vc,) 
are the unique elliptic curve key pairs of H, B, and I, 
respectively. Suppose H has an authentic and actual 
copy of Certs which signature was verified with the 

45 authentic copy of vs ( and the B has an authentic and 
actual copy of Certn which signature was verified with 
the authentic copy of vs t . Then the same phases as for 
the individual watermark protection apparatus have to 
be applied. 

50 

Remark: 

[0031] Since the generated asymmetric key pairs are 
unique, the ICH can be uniquely identified if no addi- 
55 tional watermarks by unauthorized persons have been 
encoded into the SI of the ICH. The ICO based water- 
mark protection provides the necessary counter meas- 
ures to prevent this threat. 
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c) ICO based watermark protection: 

[0032] As shown in Fig. 3, he apparatus for the ICO 
based watermark protection is partitioned into four proc- 
esses, namely the ICH with the name H, the IB process 
with the name B, the PKI process with the name I, and 
the ICO process with the name O. Suppose (ps h ,vsh). 
(PCh, vc H ), (ps B ,vs B ), (pc B , vc B ), (PS,.VS|) (pc,, vc,), (PSq, 
vs 0 ), and (pc^vco) are the unique elliptic curve key 
pairs of H, B, I and O, respectively. H has an authentic 
copy of Cert B and Certo whose signatures were verified 
with the authentic copy of vS|, B has an authentic copy 
of Certn and Certo whose signatures were verified with 
the authentic copy of VS|, and O has an authentic copy 
of Cert H and Cert B whose signatures were verified with 
the authentic copy of vs|. 

[0033] The following phases are applied by the proc- 
esses of the ICO based copyright protection apparatus: 

Phase 1 to Phase 3: See Phase 1 to Phase 3 of the Indi- 
vidual watermark protection. 

Phage 4: 

H stores the resulting stego image SI. 
Phase 5: 

H and O execute the following steps for the secure reg- 
istration or validation of copyright requests, and the gen- 
eration of copyright certificates. 

1 . H and O execute 

AKAP(H, O. K ho . ps H . vs H , pc H , vc H , ps 0 , vSq, 
pc 0 . vc 0 ) 



step shall be executed. In any other case, the 
processing and communication between the H and 
O is stopped. O verifies the CRD with respect to 
legal copyright issues (uniqueness, originality, etc.). 
5 tf the data has been successfully verified then the 

next step shall be executed. In any other case, the 
processing and communication between the H and 
O is stopped. 

4. If verification was successful, O generates the 
10 corresponding digital copyright certificate executing 

DSSAP G (ps 0 , CCD, SigCCD). 

O then stores the copyright certificate CC := 
is CCD||SigCC and generates then the Copyright 
Confirmation Reply CCR 

CCR := <K HO [TD||SigTD]>, with 
TD := CC||TVP||0||H, and DSSAP G (ps 0 , TD, 
20 SigTD). 

O then transmits CCR to H. 

5. H receives CCR, deciphers K HO [TD|| SigTD], and 
verifies TD, applying 

25 

DSSAP v (vs H . SigTD, IVR), 

where IVR denotes the intermediate verification 
result. If IVR = crh(TD), with TD := CC||TVP||0||H t 
30 then TD has been successfully verified. H then ver- 
ifies and stores the CC. 

The following phase can now be executed repeat- 
edly, if necessary, without repetition of the previous 
phases. 

35 

Phase 6: 



for the generation of a shared symmetric session 
key K HB . 

2. H retrieves the CRD and generates the copyright 
request CR, 

CR := <K HB [TD||SigTD]>, with 

TD := CRD||TVP||H||0, and DSSAP G (ps H , TD, 

SigTD). 

H then transmits CR to O. 

3. O receives CR, deciphers K HB [TD|| SigTD], and 
verifies TD, applying 

DSSAP v (vs H , SigTD, IVR) 

where IVR denotes the intermediate verification 
result. If 

IVR = crh(TD), with TD := CRD||TVP||H||0, 
then TD has been successfully verified and the next 



H and B execute the following steps for the trading of 
copyright protected digital images: 

1. H and B execute 

AKAP(H, B ( K HB . PSh. vs H , pc H , vc H , ps B , vs B , 
peg, vc B ) 

for the generation of a shared symmetric session 
key K HB . 

2. B generates the trading transaction T1, 

T1 := <K HB [TD||SigTD] >, with 

TD := ID CI ||TVP||B||H, and DSSAP Q (ps B TD 

SigTD). 



B then transmits T1 to H. 
55 3. H receives T1, deciphers K HB [TD||SigTD]. and 
verifies TD, applying 

DSSAP v (vs B SigTD IVR) 
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where IVR denotes the intermediate verification 
result. If 

IVR = crh(TD), with TD := ID C ,||TVP||B||H, 

then TD has been successfully verified and the next 
step shall be executed. In any other case, the 
processing and communication between the H and 
B is stopped. 

4. If the verification was successful, H retrieves with 
the ID C( information the corresponding stego image 
SI and generates the trading transaction 



[0038] Each of these three aspects can be applied to 
conventional watermarking techniques. Preferably, they 
are used in combination to provide a highly reliable, 
robust and powerful method for marking data sets. This 
5 method can be applied for any watermarking applica- 
tions, in particular to the application described in section 
Hot this disclosure. 

[0039] Steps a) and b) can be used for embedding 
watermarks in any type of data while step c) is opti- 
10 mized for embedding watermarks in images. 

[0040] In the following, the three elements of the 
watermarking technique are described in detail. 



T2 := <K HB |TD||SigTD]>, with 

TD := SI ||TVP||H||B, and DSSAP G (ps H 

SigTD). 



TD 75 



H then transmits T2 to B. 

5. B receives T2, deciphers K HB [TD|| SigTD], and 
verifies TD, applying 

DSSAPv(vsh. SigTD, IVR). 



20 



Ili a) Error control coding 

[0041 ] Error control coding is applied to the message 
prior to encoding step 1 1 1, a). When used in combination 
with the procedure described in section H, the message 
corresponds to one of the blocks BL,. 
[0042] Preferably, symbol based Reed Solomon (RS) 
codes are applied for this purpose. The advantages are 
the following: 



where IVR denotes the intermediate verification 
result. If IVR = crh(TD), with TD := SI||TVP||H||B, 
then TD has been successfully verified. B stores 
then the SI. 

Remark: 

[0034] B may check the copyright certificate request- 
ing O to transfer an authentic copy of the copyright cer- 
tificate for a given image identifier ID C) . Except the data 
transferred, the applied protocol is the same as 
described in phase 4. 

[0035] If B would like to transfer a specific copyright of 
a CI to another legal party, he may initiate a copyright 
revocation request with O. The different phases of this 
request are analogue to the copyright request. 
[0036] The method described in this section II 
requires a suitable watermarking technique. Various 
such techniques are known and can be employed. How- 
ever, a preferred technique is described in the next sec- 
tion. 

III. Embedding the watermarks 



RS codes correct symbol errors rather than bit 
25 errors, and 

RS codes can correct erasures as well as errors. 

Erasures can be factored out of the key equation. 

which means that "erased" symbols can be 

ignored. They do not play any role in the error con- 
30 trol mechanism - an erasure is useless redundancy. 

[0043] Being able to discard erased symbols has two 
advantages: 

35 - tf the posterior probability of a received symbol is 
low, it may be ignored. 

RS codes only come in standard sizes. For exam- 
ple a 255 x 8 bit code is common. Most commonly 
used RS error control codes appear to be too large 
40 to be used in watermarking. However, it is possible 
to make almost any RS code fit a watermarking 
application by judiciously selecting symbols as 
being erased (because they were never embedded 
in the image in the first place). 

45 

lll.b) Encoding the message 



[0037] The watermarking technique described here 
comprises the following steps: 

a) An error-control coding technique for the mes- 
sage to be transmitted in the watermark; 

b) A encoding technique to encode the message 
resulting from step a): 

c) A reliable method for embedding the encoded 
message from step b) in the image without intro- 
ducing visible artifacts. 



[0044] During encoding, the message to be transmit- 
ted in the watermark is transformed into a form suited 

so for being used in the modulation of image components. 
At the same time, it is encrypted using a suitable key. 
[0045] If used with the method of section II, the encod- 
ing procedure has access to the cryptographic keys Ph 
and v H (or their hash values), which are applied as 

55 seeds to generate pseudo-random sequences as 
described betow. The public key is used for encoding 
the message of the public watermark, the private key is 
used for the private watermark. Knowledge of the corre- 
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sponding key (or hash value) is required for recovering 
the message from the watermark 
[0046] A watermark may be embedded or extracted by 
the key owner. In this form spread spectrum is a sym- 
metric key cryptosystem. From the point of view of s 
embedding watermarks in images given the crypto- 
graphic keys the sequences themselves can be gener- 
ated. A good spread spectrum sequence is one which 
combines desirable statistical properties such as uni- 
formly low cross correlation with cryptographic security. 
[0047] Suppose we are given a message B (e.g. that 
was provided with error coding in above step Ili a). The 
message has the binary form b^. ..b L , where bj are its 
bits. This can be written in the form of a set of symbols 
s *\$z ■ - -Sm * most generally by a change in a number 
base from 2 to B. The next stage is to encode each sym- 
bol Sj in the form of a pseudo random vector of length N, 
wherein each element of this vector either takes the 
value 0 or 1 . N is e.g. in the order of 1 000 to 1 0000 (typ- 
ically in the order of 10% of the total number of image 
coefficients (Fourier components) that can, theoreti- 
cally, be modulated). 

[0048] In a preferred embodiment, this is carried out 
by using a pseudo random generator seeded by the key 
crh(p H ) or crh(v„) 

[0049] To encode the first symbol a pseudo random 
sequence v of length N + B • 1 is generated. To encode 
a symbol of values where 0 < s < B the elements v s , v s+1 
• ■- v s+n-i are extracted as a vector r 1 of length N. For the 
next symbol another independent pseudo random 
sequence is generated and the symbol encoded as a 
random vector r 2 . Each successive symbol is encoded 
in the same way. Note that even if the same symbol 
occurs in different positions in the sequence, no colli- 
sion is possible because the random sequences used to 
encode them are different - in fact they are statistically 
independent. Finally the entire sequence of symbols is 
encoded as the summation: 



[0050] The pseudo- random vector m has N elements, 
each varying between 0 and M. In a next step, the ele- 
ments of m are offset to make their mean zero. These 
elements will determine the strength of modulation of 
the Fourier components of the image in step II I.e. 
[0051] When decoding the watermark, a vector rrV 
(read-out message) is derived from the stego-image. In 
oblivious watermarking, m' corresponds to the modu- 
lated Fourier coefficients. Hence, in general m' will not 
be equal but "similar" to m. 

[0052] To decode s from m\ the elements of m' are 
first offset to make their mean zero. Then, starting from 
the (known) seed, the first random sequence v of length 
N + B - 1 is generated and the correlation of v with nV is 
calculated. The peak of the correlation indicates the off- 



set s 1 in the random sequence that was used for gener- 
ating r v Then, the next random sequence v is 
generated and cross-correlated with m' to retrieve S2, 
etc. 

[0053] Reliable communications of the apparatus are 
best accommodated by using m-sequences that pos- 
sess minimum cross correlation with each other. This is 
the same as maximizing the Euclidean distance 
between vectors v 1t v 2 . v 3 ... . 

[0054] If M is sufficiently large, the statistical distribu- 
tion of the message m should approach a Gaussian 
(Central Limit Theorem). A Gaussian distributed water- 
mark has the advantage that it is more difficult to detect. 
The variance increases with order M 1/2 ; in other words, 
the expected peak excursion of the sequence is only 
order M iy2 . 

Ill.c) Embedding the message in the image 

[0055] In this step, the encoded message m (e.g. as 
obtained in the previous step) is applied to the image for 
generating the watermark. 

[0056] In contrast to steps III. a) and IM.b), embedding 
the message in the image requires some knowledge of 
the nature of the data stored in the image. In the follow- 
ing, the image is assumed to be a two-dimensional 
image. The method is optimized for robustness against 
operations generally applied to images such as transla- 
tion, cropping, rotating, scaling. (The method is not opti- 
mized for other types of data, such as sound or text.) 
[0057] In order to achieve robustness against circular 
translation, the image block is first subjected to a Fou- 
rier transform. Then, message m is used to modulate 
the Fourier components. In addition to this, a template is 
embedded in the image, which template can be used for 
detecting a rotation and scaling of the image when read- 
ing the watermark. A tiling mechanism and suitable 
phase-dependent correction are applied for providing 
robustness against cropping. 

[0058] Figure 4 shows a detailed diagram describing 
the embedding of the watermark. Calculation starts 
from the cover image: 

1 . If the image is a color image, then compute the 
luminance component (by replacing each pixel by 
g/2 + r/3 + b/6, where g, r and b are its green, red 
and blue components) and use these values for the 
following calculations. 

2. Divide the image into adjacent blocks of size 128 
x 1 28 pixels. 

3. Map the image luminance levels (or gray levels 
for a black and white image) because it corre- 
sponds to a perceptually "flat" domain by replacing 
them with their logarithm. The logarithm is a good 
choice because it corresponds of the Weber-Fech- 
ner law which describes the response of the human 
visual system to changes of luminance. 

4. Compute the FFT (Fast Fourier Transform) of 
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each block. From the real and imaginary compo- 
nents obtained in this way, calculate corresponding 
magnitude and phase components. The magnitude 
components are translation invariant and will there- 
fore be used in the following modulation steps. 5 
(However, it is possible to derive translation invari- 
ants from the phase spectrum as well, which could 
also be modulated). 

5. Select the magnitude components to be modu- 
lated. To encode a message m of length N, a total 10 
number of N components are modulated. In non- 
oblivious watermarking, any components can be 
modulated. For oblivious watermarking, because of 
interference of the cover image with the watermark, 
the largest (highest energy) components (at about 15 
the lowest 1 0% of the frequencies) are avoided and 
components at medium frequencies (about next 
30%) are used. These figures are chosen because 
they generally give a good compromise between 
robustness and visibility of the watermark. There 20 
are two methods for selecting the components to be 
modulated: 

a) The selection of the components to be mod- 
ulated does not depend on the given image. 25 
Rather, the same components are selected for 
every image. The author as well as the reader 

of the watermark know the positions of the 
components to be selected in advance. 

b) The largest components (inside the allowa- 30 
ble frequency range) are used for modulation. 

When selecting the components to be modulated, 
care must be taken to preserve the symmetry 
imposed on the Fourier components F(k 1( k2) by 35 
the fact that the image block is real valued: 

F(k 1 ,k 2 ) = F*(N 1 -k 1 ,N 2 -k 2 ) 
(where N 1( N 2 designate the size of the image 
block). Once the magnitude components (M 1( ... 
M N ) to be modulated are chosen, the correspond- 40 
ing value rrij of message m is added to or sub- 
tracted from the corresponding selected magnitude 
component Mj. Addition is used, if the correspond- 
ing phase component Pj is between 0 and n % sub- 
traction if it is between n and 27c. This provides 45 
robustness against translation and cropping (see 
below). 

Before adding/subtracting the values mj to/from Mj, 
the vector m can be scaled to adjust the magnitude 
of its elements to those of the components Mj. so 
Generally, the elements m f should be in the same 
order of magnitude as the components Mj. The 
depth of modulation or amplitude of the embedded 
signal should depend on the objective measure of 
the perceptual significance. The lower the percep- ss 
tual significance, the higher should be the ampli- 
tude of the watermark. However, for simplicity, the 
amplitude for all components is kept constant. 



6. Add a template by a second modulation of the 
magnitude components. This is described in more 
detail below. 

7. Compute the inverse FFT using the phase com- 
ponents and the modulated magnitude compo- 
nents. 

8. Compute the inverse of the perceptual mapping 
function of step 3. For Weber-Fechner law map- 
ping, the inverse function is an exponential. 

9. Replace each watermarked block in the image to 
obtain the stego image. 

10. If the image is a color image, then rescale the 
red, green and blue components by the relative 
change in luminance introduced by embedding a 
watermark. Typically, the red, green and blue pixels 
occupy a byte each in program memory. If overflow 
or underflow occurs then the pixel is set to the 
upper bound 255 or lower bound 0 respectively. 

Template: 

[0059] As mentioned above, a template is added to 
the image in step 6. The steps for generating the tem- 
plate are illustrated in Fig. 5: 

20. Apply a log-polar map to the magnitude compo- 
nents, i.e. transform them into a polar coordinate 
system (©, log-r) with logarithmic radius axis. 

In this representation, a scaling of the image leads 
to an offset of the components along the log-r axis. 
A rotation of the image leads to an offset along the 
@ axis. 

Preferably, low pass filtering is used for interpolat- 
ing the frequency space components during this 
mapping. 

The magnitude components belonging to very low 
or high frequencies are not mapped. The following 
modulation is only applied to components in 
medium frequency range. 

21. Select the magnitude components in the log- 
polar coordinate system to be modulated. Typically, 
about 10% of all components are to be modulated. 
The pattern T formed by the selected components 
in log polar space should be such that its auto-cor- 
relation under translation is weak. For this purpose, 
the indices of the selected components should be 
coprime or be derived from a two-dimensional ran- 
dom sequence. 

Each selected component is increased by a given 
value. 

22. Map the modulated points by change of coordi- 
nates back into frequency space. 

[0060] The pattern T formed by the selected compo- 
nents in log polar space is predefined and known to the 
reader of the watermark. 

[0061 ] It must be noted that the calculation of the log- 
polar transform is not required for generating the tem- 
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plate. Instead of this, the pattern T of the components to 
be modulated in log-polar space can be mapped back to 
frequency space, which results in a pattern T in fre- 
quency space that can be applied directly to (e.g. added 
to) the components in frequency space. 
[0062] As will be explained below, the template is not 
required for non-oblivious watermarking. 
[0063] Figure 6 shows a detailed diagram illustrating 
the steps for reading a watermarkfrom the stego image: 

31 . If the image is a color image then compute the 
luminance component and use these values for the 
following calculations. 

32. Divide the image into adjacent blocks of size 
128 x 128. 

33. Map the image luminance levels (or gray levels) 
to the perceptually "flat" domain by replacing them 
with their logarithm. 

34. For each block compute the FFT. 

35. Determine the rotation and scaling that the 
image suffered by finding the template in log-polar 
space. This is described below. 

36. Using the results of step 35, read the modulated 
components to generate message m\ This requires 
the knowledge of the method that was used in step 
5 for selecting the components to be modulated. 

[0064] Once that the message m' is recovered, it is 
demodulated and error corrected using the methods 
described in sections 1 1 1. a) and 1 1 Lb). 

Finding the template: 

[0065] The steps for finding the template are illus- 
trated in Fig. 7: 

40. Apply log-polar mapping to the magnitude com- 
ponents of the Fourier transform. The magnitude 
components belonging to very low or high frequen- 
cies are not mapped. The following analysis is only 
applied to components in medium frequency range 

41. For oblivious watermarking, calculate the nor- 
malized cross correlation of the components in log- 
polar space with the template pattern T that was 
used for generating the template in step 21 and find 
the point of best correlation. If the image has nei- 
ther been rotated or scaled, this point is at zero. 
Scaling leads to a corresponding offset along the 
log-r axis, rotation to a corresponding offset along 
the © axis. 

For non-oblivious watermarking, the log polar trans- 
form of the Fourier components of the cover image 
can be used instead of template pattern T for 
retrieving scaling and rotation. 
The cross correlation can be calculated efficiently 
using conventional Fourier techniques. 



Properties of the watermark: 

[0066] In the following, some of the properties of the 
watermark generated using the steps described above 
s are discussed. 

Resistance to cropping: 

[0067] One feature of translation invariants developed 
w using the Fourier transform is that they are invariant to 
circular translations (or cyclic shifts). This is used to 
construct watermarks that are invariant to cropping. 
This is illustrated by reference to Figs. 8 and 9. 
[0068] As mentioned above, the image is split into 
15 blocks and the watermark is applied to each block, tn 
other words, the same modulation pattern is applied to 
the Fourier components of each block, wherein the 
modulation pattern is given by the corresponding 
encoded messages m. 
20 [0069] Fig. 8 shows such an image where the fat lines 
100 designate the borders between the blocks. Sup- 
pose that the watermark in a standard size block will be 
of the form: 

25 T=[A B ; C D] 

where the submatrices A, B, C and D are of arbi- 
trary size. A circular translation of such a watermark is 
of the form: 

30 

S=[D C : B A]. 

[0070] The original stego image is tiled with water- 
marks in the pattern [TTTT;TTTT;TTTT|. There- 

35 fore, a cropped section of the matrix will carry a 
watermark in the form [SSSS;SSSS;SSSS]. This 
is illustrated in Figure 9. When reading the watermark of 
the cropped image of Fig. 9, each block carries the 
watermark S. Since S is a circular transform of T, it can 

40 be read without problems in the Fourier domain using 
the steps outlined above. 

[0071 ] Note, however, that the cover image is not tiled, 
only the watermark is. Therefore, while cropping merely 
induces a circular translation of the watermark in each 

45 block, the change of image in each block is not a circular 
translation. To compensate for this, the phase compo- 
nents P( of the Fourier transform must be used for cor- 
recting the sign of the modulation of the magnitude 
components Mj, as it is outlined under step 5 above. 

so [0072] The optimum size of block depends on a 
number of different factors. A size that is a power of two 
is useful because the FFT can be used. The block size 
also must be small enough to withstand cropping but 
large enough to comfortably contain a watermark. The 

55 best compromise for block size is 1 28. 
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Resistance to scaling and rotation: 

[0073] As mentioned above, reading the template in 
log-polar space allows to detect and measure any scal- 
ing and/or rotation that was applied to the image. This s 
information can then be used for reading the watermark. 
Since the reader knows the pattern that was used for 
modulating the magnitude components in step 5, he can 
identify the modulated components in the scaled and 
rotated image and derive the message m' therefrom. w 
[0074] Note that the apparatus does not explicitly use 
a rotation and scale invariant watermark but instead 
searches the parameter space of rotations and scales. 
Since searching the space of rotation and scales in the 
frequency or space domain is quite complicated, the 75 
log-polar map is used where these parameters are Car- 
tesian coordinates and can be searched using efficient 
correlation techniques. 



Redundancy: 



IV. Summary 



20 



[0075] The watermark is embedded in blocks of a 
fixed size with exactly the same watermark embedded 
in each block. This means that the watermark can be 
recovered from a single block only. This leads to a 25 
redundancy that increases the chance of extracting the 
watermark correctly from more than one block. 



30 



[0076] The following summarizes some of the proper- 
ties of the preferred embodiments of the invention. 
[0077] The use of an asymmetric cryptographic key 
pair for the seed generation enables the execution of 
asymmetric key agreement protocols with message 35 
recovery or appendix and the protection of the commu- 
nication between the involved parties. Different security 
services for the communication, such as mutual authen- 
tication, integrity, confidentiality and non-repudiation are 
supported by the system with one asymmetric crypto- 40 
graphic key pair of the watermark author only for a reg- 
istration or trading process 

[0078] The present technique enables a strong bind- 
ing relation between the image ID, the image, and the 
ICH rf the ICH registers his copyright at the ICO. If an 45 
image is watermarked later by an unauthorized person, 
the time stamp in the copyright certificates resolves the 
copyright ownership. 

[0079] The ICH does not have to reveal his private 
cryptographic key if ownership verification has to be so 
applied by a different legal party. 
[0080] The present technique supports transferral of 
copyrights. If copyright is transferred to another legal 
party, corresponding copyright revocation certificates 
may be generated. ss 
[0081] Digital signatures techniques are applied for 
the security of the communication between different 
parties and the authentication data embedded in a pri- 



vate or public watermark of an image. No signature 
labeling techniques of the complete image are applied 
by the system. 

[0082] The Fourier-Mellin transform has been 
enhanced as described above. The Fourier Mellin 
Transform is the Fourier Transform of a log polar map. In 
the present invention, the log polar map of a Fourier 
transform is used as a means of facilitating rotation and 
scaling invariance. 

[0083] Circular translation invariants are used as a 
means of constructing digital watermarks that are invar- 
iant to cropping. 

[0084] In contrast to some known techniques, the 
present system does not require a database of all 
watermarks that were ever embedded in image any- 
where. 

[0085] Information is embedded and/or retrieved in 
the log polar domain of the Fourier transform. Fre- 
quency components are modulated which are oblivious 
to the cover image but which also have the property that 
they form an unambiguous non-repeated pattern in log- 
polar space. They are used for determining the degree 
of rotation and scaling suffered by a stego-image in the 
absence of the cover-image. Coprime frequencies are 
useful for generating such a pattern or template. Uni- 
form random sampling of log polar space is another 
method that can be applied. 

[0086] The technique applies a new concept "of invar- 
iants which are based on the modification of the well 
known FM transform and the coprime frequencies. 
[0087] The methods described above can be incorpo- 
rated into an apparatus, such as one or more comput- 
ers, using know programming and hardware 
techniques. To prove the feasibility of the approach, a 
Java based copyright protection and authentication 
environment for digital images has been implemented. 
The PKI, the ICH, the ICO, and the IB application proc- 
esses all implement a Graphical User Interface and a 
server, supporting both console users and other 
requests through a socket interface. 

Claims 

1 . A method for generating and transmitting a data set 
between two parties H and B comprising the steps 
of 

a) providing a cover data set (CI) correspond- 
ing to the data set to be transmitted, 

b) generating a stego data set (SI) of said cover 
data set (CI) by embedding at least one digital 
watermark in said cover data set (CI), wherein 
said watermark is encoded using at least one 
key of an asymmetric cryptographic key pair 
(ps H , vs H ) of H, said key pair comprising a 
secret private key (ps H ) and a known public key 
(vs H ) derived therefrom, 

c) establishing a cryptographically secure 
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transmission between parties H and B with a 
key protocol using at least said key pair (ps H , 
vs H ) of H, 

d) transmitting said stego data set (SI) from 
said party H to said party B within said secure 
transmission. 

2. The method of claim 1, wherein said cryptographi- 
cally secure transmission between said parties H 
and B is established using an asymmetric key pro- 
tocol (AKAP(H,B,K hb ,ps h ,vsh,psb,vsb)) based on 
said key pair (ps H , vs H ) of H and a private and pub- 
lic asymmetric cryptographic key pair (ps B , vsb) of 
B for generating a common key (K HB ) between said 
parties H and B. 

3. The method of one of the preceding claims wherein 
said key pair (ps H . vs H ) of H is an elliptic curve key 
pair. 

4. The method of one of the preceding claims wherein 
said step b) further comprises the steps of 

generating at least one private watermark, 

wherein said private watermark is encoded 

using said private key (ps H ) of H, and prefera- 
bly also 

generating at least one public watermark, 

wherein said public watermark is encoded 
using said public key (vs H ) of K 

5. The method of claim 4 wherein said private water- 
mark is encoded using a hash value (crh(ps H )) of 
said private key (ps H ) and can be decoded by using 
said hash value (crh(ps H ))- 



for each of said symbols (Sj), calculating a sym- 
bol vector (rj), wherein all elements of said vec- 
tor are derived from numbers from said pseudo 
random generator, 
5 adding said symbol vectors (rj) to generate an 

encoded message (m) and using said encoded 
message for embedding said watermark. 

9. The method of claim 8 wherein for each of said 
10 symbols (Sj) said pseudo random generator is used 

lor generating a pseudo random sequence of num- 
bers (v-, , v 2 , ...), and wherein the value of said sym- 
bol (Sj) is used for selecting a sub-sequence within 
said pseudo random sequence for forming said 
75 symbol vector (rj. 

10. The method of one of the claims 8 or 9 comprising 
the following steps for decoding said watermark: 

20 extracting a read-out message (m') from said 

watermark, said read-out message being a 
vector having the same length, if erased ele- 
ments are replaced by zero, as said symbol 
vectors (rj), 

25 generating all possible values of said symbol 

vectors (r) using said pseudo random genera- 
tor seeded with said seed and calculating the 
correlation between all said possible values 
and said read-out message (nV). 

30 

1 1 . The method of claims 9 and 1 0 comprising the step 
of calculating the cross-correlation between said 
pseudo random sequences of numbers (v 1( v 2 , ...) 
and said read-out message (m') for retrieving said 

35 symbols (Sj). 



6. The method of one of the preceding claims wherein 
said step b) comprises the step of generating at 
least one public watermark, wherein said public 
watermark is encoded using a hash value 
(crh(vs H )) of said public key (vs H ) of H. 

7. The method of one of the preceding claims wherein 
said step b) comprises the steps of 

i) providing a message (s 1( s 2 s M ) to be 

transmitted in said at least one water mark, said 
message consisting of a plurality of symbols, 

ii) providing a pseudo random generator 
seeded with a seed value derived from at least 
one key of said key pair (ps H , vs H ) of H or a 
hash value thereof, 

iii) encoding said message using values from 
said pseudo random generator. 

8. The method of claims 7 wherein said step iii) com- 
prises 



12. The method of one of the preceding claims com- 
prising the step of encoding a message for being 
embedded in said watermark by using symbol 

40 based Reed Solomon codes. 

13. The method of one of the preceding claims charac- 
terized in that said step b) further comprises the 
step of calculating a logarithm of said cover data set 

45 (CI) before embedding said watermark for embed- 
ding said watermark in a perceptually flat domain. 

14. Method for generating a stego data set (SI) of a 
cover data set (CI) especially for step b) of one of 

so the preceding claims comprising the steps of 

generating at least one message (IAD a ). 
applying a digital signature to said message 
(IAD C |) using an asymmetric cryptographic key 
55 pair (p H , v h ). 

generating said stego data set (SI) of said 
cover data set (CI) by generating at least one 
digital watermark in said cover data set (CI), 
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wherein said watermark contains said mes- Fourier components ol said stego image for 

sage (IAD C |). evaluating a scaling and/or rotation factor. 



1 5. Method for generating and transmitting a data set 
between two parties H and B, especially of one of 
the preceding claims, comprising the steps of 

providing a cover data set (CI) corresponding 
to the data set to be transmitted, 
generating a stego data set (SI) of said cover 
data set (CI) at a party H by generating at least 
one digital watermark in said cover data set 
(CI). 

transmitting said stego data set (SI) to a regis- 
tration party (O), and 

permanently storing certification data (CCD) at 
said registration party (O), said certification 
data comprising a hash value of said stego 
data set (SI), a digital time stamp (TVP) and 
information designating said party H. 

16. The method of claim 15 further comprising the 
steps of generating a digital signature of said certi- 
fication data (CCD) using an asymmetric crypto- 
graphic key pair (ps Ql vs Q ) of said registration party 
(O). transmitting said certification data (CCD) and 
said digital signature to said party H, and verifying 
said digital signature at said party H by using a pub- 
lic key (vsq) of said key pair of said registration 
party. 

17. Method for generating and verifying a watermark in 
a cover data set (CI) representing a cover image, 
especially for step b) of one of the preceding 
claims, comprising the following steps for generat- 
ing said watermark 



18. The method of claim 1 7 wherein said step B) further 
5 comprises the steps of 

calculating a log-polar transform of said com- 
ponents of said cover image for generating log- 
polar components, 
w modulating said log polar components using a 

log-polar transform (T) of said modulation pat- 
tern (T). 

19. Method for generating a watermark in a cover data 
15 set (CI) representing a cover image especially for 

one of the preceding claims, characterized by the 
step of dividing said image into a plurality of adja- 
cent blocks and by the following steps carried out 
for each block: 

20 

calculating the Fourier transform of the block of 
the block, and 

modulating at least part of the magnitude com- 
ponents of the Fourier transform of the block 
25 using a modulation pattern, wherein the same 

modulation pattern is used for all blocks. 

20. The method of claim 19, wherein the modulation 
pattern determines values to be added and/or sub- 

30 tracted for each of said magnitude components and 
wherein, at each frequency, the corresponding 
phase component of the Fourier transform is used 
for determining if said value is to be added or sub- 
tracted from said magnitude component. 

35 



A) calculating the Fourier transform of at least 
part of said cover image for generating Fourier 
components of said cover image, and 40 

B) modulating at least part of said Fourier com- 
ponents using a template modulation pattern 

cn, 

C) using the inverse Fourier transform for gen- 
erating a stego image, 45 
said method further comprising the following 
steps for verifying said watermark in a possibly 
scaled and/or rotated version of said stego 
image, 

D) calculating the Fourier transform of the pos- so 
sibly scaled and/or rotated version of said 
stego image for generating Fourier compo- 
nents of said stego image, 

E) calculating a log-polar transform of said Fou- 
rier components of said stego image, and ss 

F) calculating the cross correlation between a 
log -polar transform (T) of said modulation pat- 
tern (T) and said log-polar transform of said 
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